UNCLASSIFIED 


AD- °%l 


RIA-80-U629 


AD-AOZk  OS!/ 


iLCHlNiCAL 

w LIBRARY 


Defense  Documentation  Center 

Defense  Supply  Agency 

Cameron  Station  • Alexandria,  Virginia 


UNCLASSIFIED 


ADA02608! 


FINAL  REPORT 
IRO  REPORT  NTQ.  219 


DEMAND  FORECASTS  USING  PROCESS 


MODELS  & ITEM  CLASS  PARAMETERS: 
APPLICATION  OF 
ANCILLARY  VARIABLES 


D D C 


nmjaffmrjEtrfl 

Uj  JUN  29  l^6 


0S15D 

— A 


y 


April  1976 


A Md  | luff  t«»,  V«  Il'MI  IWI  I 


^ DSC  MVOnORY 
RESEARCH  OFFICE 
FRAHKFORD  ARSBIAl 


— — 


DEMAND  FORECASTS  USING  PROCESS  MODELS  & ITEM 
CLASS  PARAMETERS:  APPLICATION  OF  ANCILLARY 

VARIABLES 


FINAL  REPORT 
BY 

DONALD  ORR 
APRIL  1976 


APPROVED  FOR  PUBLIC  RELEASE:  DISTRIBUTION  UNLIMITED 


USDRC  INVENTORY  RESEARCH  OFFICE 
US  ARMY  LOGISTICS  MANAGEMENT  CENTER 
FORT  LEE,  VIRGINIA 


I •»  — * 

r»  • 

t«.f  tlCM  wl 


i.MC 


SECURITY  CLASSIFICATION  OF  THIS  PACE  (Whan  Data  entered) 


REPORT  DOCUMENTATION  PAGE 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


I.  REPORT  NUMBER 


2.  GOVT  ACCESSION  NO 


3.  RECIPIENT'S  CATALOG  NUMBER 


4.  TITLE  (and  Subtltla) 


* YPE  OF  REPORT  A PERIOD  COVERED 


DEMAND  FORECASTS  USING  PROCESS  MODELS  VlTEM 
£LASS  PARAMETERS:  APPLICATION  OF  ANCILLARY  1 
VARIABLES  * — 


Final  Report^/ 


A PERFORMING  OBO.  REPORT  NUMBER 


7.  AUTHOR  (a) 


8.  CONTRACT  OR  GRANT  NOMOCR/«J 


/ 


DONALD/ORR 


i/q* 


•f^PWFORWINirDKCANlZATlON  NAME  AND  AOORESS 


T.HO-ZI  I 


10.  PROGRAM  ELEMENT.  PROJECT,  TASK 
AREA  A WORK  UNIT  NUMBERS 


. CONTROLLING  OFFICE  NAME  ANO  AODRESS 

DRC  Inventory  Research  Office 
US  Army  Logistics  Management  Center 


(jjx 


1 2 . REPORT  nftTF  — 

April  "1976  i 

■n.  "NUUBEIToF  PAGES 


70 


U MONITORING  AGENCY  NAME  A ADORESVH  dlttaront  /root  Controlling  Ottlca) 

US  Army  Materiel  Development  & Readiness  Command 
Directorate  of  Supply  f ^ \//l^ 

5001  Eisenhower  Avenue  , / J ) / j 

Alexandria,  VA  22333  \'  J 1 


IS.  SECURITY  CLASS,  (o t thia  import) 

UNCLASSIFIED 


IS.  DISTRIBUTION  STATEMENT  (ot  thia  Raport) 


IS  •.  DECLASSIFICATION/ DOWNGRADING 
SCHEDULE 


Approved  for  Public  Release:  Distribution  Unlimited 


17.  DISTRIBUTION  STATEMENT  (ol  tha  abstract  entered  in  Block  70.  It  different  from  Raport) 


It.  SUPPLEMENTARY  NOTES 

Information  and  data  contained  in  this  document  are  based  on  input  avail- 
able at  the  time  of  preparation.  Because  the  results  may  be  subject  to  change 
this  document  should  not  be  construed  to  represent  the  official  position  of 
the  US  Army  Materiel  Development  & Readiness  Command  unless  so  stated. 


19.  KEY  WORDS  (Continue  on  rovorma  alda  It  nmcaaaory  and  Identity  by  block  number) 

demand  Forecasting  Error-Hrasurec 

Prbgram  Factors 
Flying  Wqurs 
Kalman  FiltusM 
Transformed  TiteeuSeries 


20.  ABSTRACT  (Continue  on  remeree  aide  It  neceeeaay  and  tdonilty  by  block  number) 

^Theoretical  and  statistical  results  are  presented  on  forecasting  a 
time  series  (Dt)  in  conjunction  with  a correlated  series  (Ht) . In  the 
particular  problem  Dt  is  demand  for  a part  which  is  on  an  aircraft 
which  flies  Ht  hours  in  period  t.  Reasonable  recursive  models  of  the 
underlying  demand  process  are  postulated  and  it  is  shown  that  theoreti- 
cally rigorous  or  heuristically  satisfactory  forecast  algorithms  can  be 
obtained  by  applying  Kalman  filter  or  weighted  moving  average  techniques 
to  4 time  series:  Dt,  Dt/Ht,  log  Dt,  log  Dt/Ht.  An  important  forecasting 


DD  1473 


EOfTION  OF  V NOV  AS  IS  OBSOLETE 


UNCLASSIFIED 


72s 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  Dots  Bnta 


I C C u WIT  Y CL  ASM  F 1C  AT  IQ  H OF  THU  PAQg  (Whmn  Dm  fm  Bnf  r»Q 


ABSTRACT  (CONT) 

'^parameter  - denoted  k - is  developed  for  the  structural  models;  k is  the 
ratio  of  the  noise  variance  of  a process  to  the  variance  of  random  changes 
in  the  process  mean.  — included  are  stratified  results  on  error  measure 

Their  performances  are  al6u  tested  in  a Simula- 


la  j. uuuu  i<  iccasts  utilizing  flying  hours  do  give  improved 

performance;  the  Mt>est*r  algorithm  is  a Kalman  filter  with  a varying  weight- 
ing parameter  which  depends  upon  the  flying  hours  in  a period  and  k,  which 
is  determined  by  the  item's  demand  frequency  class.  When  the  ancillary 
variable  (program  variable)  is  end  item  density  rather  than  flying  hours, 
the  algorithm  is  identical  but  with  different  k-values.^ 

1 Projected  savings,  over  the- current  Army  method  o£forecasting 
demands  on  the  wholesale  supply  system,  were  1.8  million  dollars  annually 
on  the  10,000  parts  in  the  data  base. 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  of  THIS  PAGEfW?i#n  Dm  hi  Entmrmd) 


ACKNOWLEDGEMENTS 


I thank  IRO  personnel  for  their  aid,  particularly: 

Martin  Cohen,  who  paved  the  way,  encountering  and  removing 
vexing  problems  in  data  editing  and  the  experimental  design  of  simulator 
runs. 

Charles  Knopf,  now  with  Exxon,  who  wrote  the  original  error 
statistics  program  and  simulation  forecasting  subroutines,  in  a versatile 
manner  facilitating  subsequent  modifications. 

Alan  Kaplan,  who  kept  abreast  of  the  probs  and  pseudo-probs  that 
evolved  from  the  project  amoeba  and  gave  helpful  suggestions. 

Marie  Francis,  who  typed  this  report  with  its  knotty  notations. 


TABLE  OF  CONfENTS 


PAGE 

ACKNOWLEDGEMENTS 1 

TABLE  OF  CONTENTS 2 

SUMMARY 

1.  Background 4 

2.  Purpose  & Objectives 4 

3.  Scope 5 

4.  Methodology 5 

5.  Results 6 

6.  Conclusions 8 

CHAPTER  I INTRODUCTION 8 

CHAPTER  II  DATA  BASE 10 

CHAPTER  III  MODELS  OF  PROCESSES  AND  FORECAST  ALGORITHMS 

3.1  Models  of  Processes 12 

3.2  Forecast  Algorithms 15 

3.3  k-Factors 19 

CHAPTER  IV  ERROR  ANALYSIS 

4.1  Computer  Program  to  Gather  Error  Statistics 21 

4.2  Error  Measures  for  One  Item 21 

4.3  k-Factor  Tables 23 

4.4  Forecast  Algorithms  - Initialization  and  k-Updating 

in  Computer  Program ^5 

4.3  Tabulated  Results  on  Error  Measures ^ 

4.6  Analysis  of  Relative  Performances  and  Trends  in 

Tables 43 

4.7  Candidates  for  Further  Study 44 

4.8  Relative  Merits  of  Statistical  Error  Measures 45 

CHAPTER  V SIMULATION  ANALYSIS 

5.1  Simulator  Overview  & Special  Features 48 

5.2  Initial  Runs 49 

5.3  Final  Four  Algorithms  and  Resulting  Curves 51 

CHAPTER  VI  SAVINGS  £.  IMPLEMENTATIONS 

6.1  Cost  Savings  Over  1794  Policy 58 


2 


TAFLE  OF  CONTENTS  (CONT) 


PACE 


6.2  Implementation  Considerations 58 

6.3  Modifications  of  Algorithms  to  Use  End  Item 

Density  as  a Program  Factor 61 

CHAPTER  VII  CONCLUSIONS,  RECOMMENDATIONS  & FUTURE  WORK 

63 

7.1  Conclusions 

7 . 2 Recommendations 

7.3  Future  Research  - Aids  L Caveats 63 

BIBLIOGRAPHY 

DISTRIBUTION 68 


V 


3 


SUMMARY 


1.  Background 

In  early  1974,  after  some  preliminary  investigative  work  by  IRO, 

6tudy  was  assigned  to  that  same  office  by  the  AMC  (now  DARCOM)  Directorate 
of  Supply,  to  formulate  and  test  methodologies  with  potential  for  improving 
demand  forecasts  for  Army  managed  secondary  items.  Moving  average  and 
exponential  smoothing  forecasting  schemes  had  been  investigated  extensively 
in  the  past  and  have  specific  data  retention  rules.  Other  more  structured 
forecasting  models  had  not  been  tested;  the  catalog  approach  for  other  than 
insurance  items,  Bayesian  estimators  which  combine  item  history  and  demand 
distributions  over  a whole  catalog  of  items,  and  techniques  (e.g.  Kalman 
filters)  which  handle  changing  demand  rates  should  be  added  to  a list  of 
potential  techniques. 

At  the  time,  Martin  Cohen  was  studying  techniques  for  forecasting  that 
utilized  program  data  (flying  hours,  end  item  densities).  The  study  re- 
ported here  did  not  duplicate  the  effort  with  those  techniques,  but  it  was 
found  that  the  procedures  (algorithms)  developed  herein  could  be  applied 
to  demands  or  to  demand  per  unit  program  rates. 

2.  Purpose  & Objectives 

PI  Investigate  untried  but  theoretically  rigorous  forecast  techniques 
including  methods  applicable  to  items  for  which  a program  factor 
is  not  feasible. 

P2  Develop  implementation  procedures  and  specifications  for  the 
retention  and  upkeep  of  item  past  history. 

01  Use  the  available  28  quarters  of  AVSCOM  demand  and  program  data 
for  forecast  model  building  and  comparative  evaluation. 

02  Determine  how  much  item  history  should  be  retained,  how  often 
should  the  retained  data  be  updated,  and  what  importance  or  weight 
should  be  attached  to  various  demand  estimators  (e.g.  how  the  age 
of  the  data  should  be  weighted). 

03  Determine  the  merit  of  various  performance  measures  for  comparing 
forecast  techniques. 


3.  Scope 


The  study  is  limited  to  developing  procedures  for  the  forecasting  of 
world-wide  recurring  demands  for  Army  managed  Class  IX  secondary  items 
(repair  parts  and  spares)  including  Stock  Fund  and  PEMA  Items.  The  pro- 
cedures are  to  be  applied  in  the  Commodity  Command  Standard  System  (CCSS) 
Inventory  management  function  implemented  at  the  Army's  National  Inventory 
Control  Points  (NICP) . 

The  focus  of  this  report  in  terms  of  a "best"  forecast  technique  is 
on  an  algorithm  which  uses  an  ancillary  variable  (FH  program  or  density 
program) . A further  study  and  subsequent  report  will  concentrate  on  the 
techniques  described  herein  which  may  be  applied  to  items  for  which  program 
data  is  not  meaningful,  and  on  the  results  utilizing  a data  base  of  such 
items. 

This  current  study  was  not  intentionally  limited  to  aircraft  items  but 
the  only  adequate  program  data  available  over  7 years  was  for  such  items. 
Methodology  Is  developed  which  extends  the  scope  to  items  from  other  Commands 
for  which  end  item  density  is  the  ancillary  variable. 

4.  Methodology 

a.  Postulate  models  of  the  demand  process. 

b.  Develop  algorithms  which  theoretically  would  best  forecast  this 
process.  At  this  point  is  also  determined  the  time  series  on  which  to  apply 
the  algorithms  - demand  D,  demand  per  flying  hour  D/H,  logarithm  of  demand 
log  D,  logarithm  of  demand  per  flying  hour  log  D/H. 

c.  Determine  algorithm  parameter  values  for  various  stratifications 
of  items,  e.g.  classify  items  by  annual  requisition  frequency. 

c.  Screen  the  many  algorithms  by  their  performance  with  several 
statistical  error  measures  (e.g.  mean  square  error  by  item  class). 

d.  Evaluate  the  remaining  candidate  algorithms  by  their  cost-performance 
averaged  over  individual  items  in  the  simulation  model  of  the  Army  supply 
management  system. 

The  final  selection  was  made  on  the  basis  of  smallest  aggregate  simulated 
inventory  cost  for  constant  time-weighted  requisitions  backordered. 
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5.  Results 


a.  "Best'*  algorithm:  Kalman  filter  (see  Section  5.3)  to  estimate 

demand  per  unit  program  (DP) . 

(1)  It  is  akin  to  exponential  smoothing  with  a varying  smoothing 
or  weighting  parameter  which  depends  upon  the  program  in  a period  (quarter) 
and  a "k-f actor". 

(2)  The  Mk-factorM  is  updated  yearly  from  the  items  demand 
frequency  class. 

(3)  Older  data  is  given  less  weight. 

(4)  Periods  with  high  program  given  more  weight. 

(5)  Forecast  - DP  x program  in  future  period. 

b.  Cost-Performance  Comparison:  "Best*'  versus  Present  Army  Program 

Factor  (1794) , based  on  simulation  projections  for  10,000  items. 

(1)  For  same  average  days  wait,  $1,800,000  annual  savings  are 
realized. 

(2)  At  constant  average  yearly  cost,  wait  is  reduced  ^ 12%. 

c.  Tables  of  parameters  are  presented  for  forecasting  by  item  class^ 
as  are  extensive  tables  of  error  measure  values  by  item  class  for  the 
various  algorithms. 

d.  Several  candidates  (non-program  related)  algorithms  for  forecasting 
common  items  have  been  found. 

6.  Conclusions 

a.  This  study  has  reinforced  Cohen's  findings  - that  forecast 
algorithms  utilizing  flying  hours  perform  better  on  the  AVSCOM  data  base 
than  strictly  demand  dependent  algorithms. 

b.  Recommended  technique  yields  substantial  improvement  in  terms  of 
cost  savings. 

c.  The  technique  can  be  applied  across  Commodity  Commands  with  only 
a change  in  algorithm  parameter  values. 


d.  Methodology  has  been  developed  which  can  be  applied  to  a broad 
spectrum  of  common  items* 
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CHAPTER 


INTRODUCTION 

In  many  approaches  to  demand  forecasting,  several  general  forecast 
techniques  (moving  averages;  single  and  double  exponential  smo)thing; 
linear  regressions  on  time  or  another  independent  variable)  are  applied 
to  groups  of  items.  Average  performances  with  respect  to  an  error  measure(s) 
are  compared;  optimal  forecast  parameters  (smoothing  parameters,  moving 
average  base)  need  to  be  determined  by  search  or  enumeration,  observing  the 
error  measure  values.  Such  approaches  are  somewhat  haphazard;  the  fore- 
cast parameters  would  be  Justified  a posteriori,  no  consistent  theory  on 
the  structure  of  the  underlying  processes  would  have  been  developed,  and 
extensions  of  empirical  results  and  the  techniques  would  be  made  more  diffi- 
cult. 

In  this  study,  several  models  of  a demand  process  or  a demand  - flying 
hour  (FH)  process  are  postulated.  Basically  the  models  consider  a process 
mean  corrupted  by  some  noise  in  the  observed  values;  in  addition  the  mean 
itself  of  the  process  is  changing  randomly  and/or  non-randomly . For  the 
most  part,  nothing  is  assumed  about  the  probability  distributions  of  the 
random  variates.  Models  for  how  the  demand  series  over  time  is  changing 
and  for  how  the  demand  per  FH  series  D^/H^  Is  changing  are  described.  For 
example  one  might  expect  that  if  a demand  - FH  relation  exists,  the  mean  of 
the  rate  D/H  would  be  relatively  stable. 

The  advantage  of  this  modeling  is  that  available  and  newly  developed 
(/3)  theory  dictates  what  are  the  optimal  and  suboptimal  forecast  algorithms 
associated  with  each  model.  For  example,  since  in  general  the  models  assume 
the  process  mean  to  be  changing,  a sample  mean  of  all  past  history  is  not 
the  best  forecast  technique.  Kalman  filters  (akin  to  exponential  smoothing 
with  changing  smoothing  constants)  and  moving  averages  with  variable  base 
lengths  are  indicated.  Also  parameters  of  the  forecast  algorithm  are  re- 
lated to  noise  variances  in  the  process.  Analysis  of  the  time  series  of 
the  process  for  groups  of  items  can  determine  these  process  noise  parameters 
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on  an  average  basis.  If  patterns  in  these  average  values  develop  over 
groups  of  items,  this  is  one  indication  that  the  model  in  question  is 
appropriate.  Finally,  these  process  parameters  lead  to  the  forecast 
parameters  without  the  need  of  a search;  and  the  performance  of  the  al- 
gorithm relative  to  others  indicates  which  model  best  describes  the  process. 

Before  proceeding  with  models  of  the  processes  and  associated  fore- 
cast algorithms  (Chapter  II),  we  briefly  describe  in  Chapter  II  the  data 
base  of  items  used  in  the  analysis.  Chapter  IV  describes  the  computer 
program  for  evaluating  the  forecasts  via  statistical  error  measures. 
Stratified  empirical  results  comparing  about  25  algorithms  are  presented, 
as  are  10  average  values  of  an  important  forecasting  parameter  - the  k 
factor  - for  items  grouped  by  requisition  frequency.  Trends  and  relative 
values  in  the  tables  are  analyzed.  In  Chapter  V,  the  most  promising  can- 
didate algorithms  are  used  as  forecast  routines  in  the  simulator  of  the 
Army  wholesale  supply  operation.  Based  on  cost  performance  in  the  simula- 
tor runs,  three  final  algorithms  for  forecasting  using  FH  are  compared  to 
the  current  AVSCOM  program  factor  technique.  Projected  savings  are  dis- 
cussed in  Chapter  VI,  as  are  implementation  considerations  and  modifications 
of  the  best  algorithm  to  utilize  end  item  density  as  the  program  factor 
rather  than  a usage  variable  (FH) . 

A short  chapter  on  conclusions,  recommendations  for  forecasting  and 
further  work  on  common  items,  and  some  caveats  or  aids  to  future  re- 
searchers ends  this  report. 
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CHAPTER  II 


DATA  BASE 


The  conclusions  in  this  report  are  based  on  studies  made  using 
chronological  demand  data  from  AVSCOM.  Flying  hours  were  obtained  from 
DCSLOG.  Details  of  the  data  organization  and  editing  are  found  in  an 
IRO  report  by  Cohen  (4-).  The  final  data  base  contained  over  10,000 
"peculiar"  parts  - those  that  are  on  only  one  type  of  aircraft  and  hence 
can  be  associated  with  specific  flying  hour  values,  A larger  data  base 
of  common  items  ( ^ 30000)  has  oeen  retained  to  study  forecast  algorithms 
developed  here  which  do  not  depend  on  usage  (FH) ; this  will  be  a future 
task  (see  Chapter  VII), 

All  data  has  been  summarized  by  quarter.  For  each  quarter  we  have 
worldwide  totals  of  the  number  of  requisitions  {r^  » the  quantity  de- 
manded {)’t  ] , and  the  flying  hours  {H^j.  The  flying  hour  totals  are 
broken  out  by  aircraft  type/nodel/series  (TMS) . The  data  spans  the  28 
quarters  from  Jan  1967  thru  Dec  1973.  The  scope  of  this  work  is  limited 
to  recurring  demand;  requisitions  for  initial  issue,  mobilization,  and 
rebuild  are  not  included. 

Table  2.1  shows  the  distribution  of  items  in  the  final  data  base  by 
classes  (definitions  follow). 

TABLE  2.1  DISTRIBUTION  BY  ITEM  CHARACTERISTICS 


ITEM  CLASS 

TOTAL  COUNT 

PEMA 

ASF 

NON-REP 

REP 

INS 

LDV  Non-Dynamics 

10350 

29 

10321 

9877 

448 

25 

LDV  Dynamic 

1008 

24 

984 

957 

51 

LDV  Total 

11358 

53 

11305 

10834 

499 

25 

HDV  Non-Dynamic 

174 

30 

144 

66 

108 

KDV  Dynamic 

99 

52 

47 

26 

73 

HDV  Total 

273 

82 

191 

92 

181 

Total  Non-Dynamics 

10524 

59 

10465 

9943 

556 

25 

Total  Dynamic 

1107 

76 

1031 

983 

124 

Total 

11631 

135 

11496 

10926 

680 

25 
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The  last  columns  give  breakouts  by  funding  (PEMA,  ASF)  and  segment 
(non-reparablc,  reparable  or  insurance  items).  Usually  PEMA  are  expensive, 
reparable  items.  HDV  items  have  in  at  least  one  year  an  average  yearly 
dollar  demand  of  at  least  $50,000  or  average  yearly  frequency  (requisitions) 
of  at  least  100;  the  LDV  class  is  comprised  of  the  other  items  (low  and 
medium  dollar  value).  Dynamic  components  are  defined  based  on  a descrip- 
tion of  the  items  FSC,  and  are  those  experiencing  high  rotation  rates 
(rotor  blades,  transmissions,  engine  components)  - the  demand  for  which 
may  be  quite  dependent  on  FH.  Non-dynamic  components  are  more  structural 
in  nature.  The  LDV  non-dynamic  class  is  intended  to  contain  relatively 
cheap  non-reparables. 

Again  refer  to  Cohen  (4)  for  a fuller  description. 


CHAPTER  III 


MODELS  OF  PROCESSES  AND  FORECAST  ALGORITHMS 


3.1  Models  of  Processes 

3.1.1  Structural  Forms  of  Underlying  Processes 
Dynamic  Mean 


yc  - 


E(?t)  - E(vt)  - o 

Var  7t  “ rc2 

Var  vrc  - qt2 

y *»  observed  value  of  process  at  time  (qtr)  t 


(31) 


e mean  of  process  at  tine  t 

2 

•y  **  additive  noise  random  variable  with  variance  r^ 

v " additive  random  change  in  mean  x from  time  t-1  to  time  t. 

C 2 
Variance  is  q 

This  model  is  sufficiently  complex  to  explain  short  term  trends  in 
a time  series.  Its  mean  is  non-stationary  in  that  it  changes  from  period 
to  period.  Moving  averages  and  single  exponential  smoothing  work  well  on 
this  process. 
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Linear  Growth 


yt ' 

■xt+\ 

xt ' 

* xt_l+et  + vc  (311) 

Bt  ■ 

E(St)  ■ 

* o Var  - pt2 

• incremental  growth  in  mean  of  process  at  tine  t 

V 

■ random  change  in  growth  term 

Other  definitions  as  above. 

This  model  allows  for  linear  growth  over  time  of  the  process  mean. 

Its  forecast  algorithm  is  a general  version  of  double  exponential  smoothing 
Linear  regression  over  time  would  do  well. 

Dynamic  Proportion 


zt 1 

« u • 0 >0  > o 

t pt  * Mc  — 

ut 1 

• U . ut  » wt  1 o (3111) 

E(pt)  ■ 

• E(ut)  » 1 

Var  pt  ■ 

■ exp  (r£2)  - 1 

Var  ut  * 

* exp  (q£2)  - 1 

Zt  ' 

= observed  value  of  process  at  time  t 

Ut  ’ 

■ mean  of  process  at  time  t 

■ 

* multiplicative  noise  random  variable 

■ 

• multiplicative  random  change  or  "percentage*1  change  in 
mean  u from  t-1  to  t. 
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Thi6  model  Is  useful  for  avoiding  theoretically  possible  negative 
values  as  in  (3i).  Random  changes  can  be  regarded  as  percentages.  With 


investigation  in  the  three  structural  forms.  The  former  will  yield  fore- 
cast algorithms  for  a demand  per  FH  rate  which  in  turn  can  be  used  to 
predict  future  demand  based  on  projected  FH.  Algorithms  for  the  latter 
process  will  also  be  developed  here  and  for  comparison  purposes  be  applied 
to  the  current  peculiar  item  data  base,  but  their  real  potential  will^e 
realized  when  forecasting  common  items  or  where  the  use  of  a program  ( F H 
factor  is  not  feasible. 


values.  Appropriate  transformations  will  then  yield  forecasts  for  demand. 


and  thereby  use  system  (3ii)  with 


8c  --1/2  qt2  , Var  &t  - o 


J.1.2  Processes  Utilized  in  Structural  Forms 


The  time 


natural  candidates  for 


In  (31)  let  xt  - E(Dt), 


then  y ** 


In  (3i)  let  « E(Dt/Ht)  then  y « D /H 


In  (3iii)  let  u - E(Dt> 


then  yt  ■ log  Dt 


In  (3iii)  let  U|.  - E(Dt/Ht)  then  yt  - log  (D  /Ht) 

It  is  now  apparent  that  past  history  of  four  time  series  { , {d  /H 
{log  Dt]  » [log  I>t/H  j may  be  used  in  algorithms  to  forecast  their  upcoming 


1, 


See  Reference  \f3] . ware  assumed  log-normally  distributed 
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x * estimate  of  mean  of  process  at  end  of  period  n 


n 


y^(0  - forecast  at  end  of  period  n of  the  process  value  £ 
periods  later 


G « variable  weight,  "smoothing  parameter" 


n 


q : as  defined  in  (3i) 


(ii)  Exponential  Smoothing 

Designator  - EXPSM  - a sub-optimal  algorithm  for 
Dynamic  Mean 

Let  G be  a constant  G.  Then  (2)  is  exponential 
n 

smoothing  relation. 

It  is  seen  in  Section  (3.3)  that  an  appropriate  G 
for  a corresponding  moving  average  of  base  B is 


(iii)  Moving  Averages  with  Fixed  or  Variable  Base  Lengths  B 
Designator  - MA4 , MA8,  MAI 2 Model  - Dynamic  Mean 
(Denotes  # Qtrs) 


'fl  ± 4c  - 1 
2c 


(4) 


with  c - (2B2  - l)/6 


(5) 


yn(0  - xn 


(6) 


(7) 


Designator  - MAKB 


as  in  (6)  and  (7)  with 


B - >/(l+6k)/2 


(8) 


where  k is  forecast  parameter  discussed  in  Section  3.3. 
With  this  B,  a moving  average  is  suboptimal. 
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3.2,2  Modified  KAL-1  Based  on  Cohere  ResultB 

2 

(i)  Designator  - KALl-H  Model  - Dynamic  Mean  for 

y - D/H 

In  Cohen's  investigation  [4],  the  best  algorithm  tested 
was  basically  REG8  described  below.  We  can  postulate  a model  for  which 
this  REG8  is  a suboptimal  algorithm. 

Dt“acHt+?t  (9,) 


at  - at-l + vt 


(10) 


Dividing  (9')  by  we  obtain 


VHC  ■ .t  + 


(9) 


where  equations (9)  and  (10)  are  in  Dynamic  Mean  form  (3i)  and  where 
Var  - 1/Ht2  Var  7'  (11) 

We  assume  a constant  k (see  Section  3.3.1)  defined  by 


Var  7 


2.  2 . 


Var 


t 2 , 

■ r /q 

v.  t Ht 


(12) 


Assuming  Var  ^ not  dependent  on  H (homoscedasticity) , 


2 2 2 2 
rt  Ht  " constant  - rt+i  Vi 


(13) 


Therefore  equation  (3)  becomes  (using  subscript  n now  to  denote  algorithm 

iterations) 

2 , 2 
q + r G 

„ n n n 


n+1  2 2 n 2 2.  2 

q + r G + r H /H 
^n  n n n n n+1 


1 + kG 


1 + k G + k H 2/H  2 

n n n+1 
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(14) 


and  a9  before  in  Section  3,2.1 


yn(0  - xn 


(15) 


< n + C -(y  - x .) 

n-1  n 'n  n-1 


(16) 


Note  that,  as  with  exponential  smoothing,  (16)  gives  less  and  leas 

weight  to  older  quarters.  On  the  other  hand  (14)  indicates  that  quarters 

with  relatively  high  FH  are  given  more  weight;  if  H t,  » H then 
<■'  n ' 1 n 


n+1 


1 and  x , , *v  y 

n+1  J n+1 


(ii)  Regression  Technique  from  Cohen  [4] 

Designator  - REG 8 Model  - Dynamic  Mean  (9) , (10) 

Use  only  with  y - D/H 


y (0  - x 

n n 


(17) 


E yn- j 1 1 ^n-J  « I 

J“1 


(18) 


where  weight  i6  given, 


2 8 2 
m ■ H . / I H 
ti-J  n-j  i_1  n-i  ■*  i 

Designator  - REGKB 

Use  B given  by  (8)  in  place  of  8 Qtrs 


(19) 


Equation  (18)  is  in  the  form  of  a weighted  moving  average.  Cohen's 
algorithm  written  in  this  way  demonstrates  its  appropriateness  for  forecast 
model  (9), (10).  According  to  theory,  the  weights  should  be  inversely 
proportional  to  the  variance  of  the  process  variables  y^  when  forming 
minimum  variance  estimators  of  the  type  (18).  REGKB  is  an  obvious 
modification,  to  allow  the  base  to  vary. 

18 


— 

I 


— 


3.2.3  Kalman  Filter  - 2nd  Order 
Designator  - KAL  2 - GEN 


Model  - Linear  Growth 


ynU)  - xn  + *en 


(20) 


x ® x . *+•  g + g . (y  ~ y„  , (D) 

n n-i  n-i  n n n— l 


(21) 


en  “ Bn-1  + V (yn  " Vl(1)) 


(22) 


G changes  as  in  (3) 
n 


H Z /(.1-G  )/(100  rl/q  2) 


n n 


(23) 


H is  an  approximation  assuming  p in  system  (3ii)  is 
n n 

small. 

(21)  and  (22)  are  again  the  basic  filter  where  variable  weights  G , H 

n n 

are  applied  to  the  one-step-ahead  error  to  obtain  adjustments  to  the 
previous  estimates  of  the  process  level  and  growth  means,  x and  ft 

3.2.4  Modified  KAL  2 for  Log  Series 

Designator  - KAL  2 - BQ  Model  - Dynamic  Proportion 


Use  (20),  (21),  (22),  (23)  with 


H * o 
n 


6n  = - 1/2  ^ 


(24) 

(25) 


This  algorithm  is  used  with  log  D or  log  D/H  series  of  values,  by 
which  (3iii)  is  transformed  to  (3ii)  thru  (3iv). 

3.3  k-Factors 

An  important  parameter  of  both  the  models  and  the  algorithm  is  the 
k-factor. 

k « Variance  of  noise  in  process 


Variance  of  random  change  in  process  mean 


2,  2 

rn  /qn 

n n 
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I 


q is  associated  with  short  term  correlations  in  changes  in  the  mean, 
n 

k is  assumed  constant  in  all  of  the  models. 

2 

If  in  addition  r does  not  vary  by  period,  i.e. 


(27) 


then  (3)  becomes 

1+k  G 


n+1 


1 + (G  +l)k 
n 


(28) 


G^  in  (28)  approaches  a limit  G 


/l~+  4k  - 1 
2k 


Orr  [/3]  shows  that  given  a dynamic  mean  model  with  parameter  k,  the  ’’best" 
(In  the  sense  of  minimizing  mean  square  error  of  Jt-pariod  ahead  forecasts) 
moving  average  algorithm  should  use  B periods  (quarters)  as  its  base  with 
B given  by  (8). 

k is  an  indicator  of  how  stationary  the  process  is;  high  k values 

imply  relatively  small  changes  in  the  process  mean  and  more  reliance 

should  be  put  on  past  history  for  forecasting;  low  k indicates  changes  4 

in  the  mean,  short  term  trends,  and  relatively  low  observation  noise, 

and  more  weight  should  be  put  on  recent  observations  (note  (28)). 

There  are  several  ways  of  obtaining  estimates  of  k.  Orr  [/3] 

obtains  formulas  for  k using  mean  square  errors  of  moving  average  forecasts. 

Average  values  of  k for  items  falling  in  cells  of  various  stratifications 

were  obtained  in  this  study.  A stratification  by  yearly  requisitions 

showed  the  most  definite  patterns  and  the  average  values  of  k are  tabulated 

in  Chapter  IV  for  the  four  time  series.  These  tabulated  results  are  used 

to  update  k every  year  in  the  above  algorithm  in  cases  where  an  item 

migrates  from  one  requisition  class  to  another.  In  a sense  the  algorithms 

have  now  become  dependent  on  a catalog  parameter  (average  k)  derived 

for  groups  of  items  which  is  updated  yearly. 

k is  quite  valuable  in  determining  the  parameters  for  suboptiraal 

algorithms.  If  one  is  constrained  to  use  a MA  or  exponential  smoothing 

algorithm  rather  than  a Kalman  filler,  equations  (4),  (5),  and  (8)  give 

all  the  necessary  relations  among  G,  B,  k and  are  a rigorous  alternative 

2 

to  Brown's  (3)  G ^ -r—r- 

B+1  20 


Mean  Absolute  Deviation 


This  error  measure  and  the  following  are  computed  for  one  quarter 
MADf>  and  four  quarters  MAD.  All  un-subecripted  measures  refer  to  yearly 
values. 


1 r+T  A 

MAD,=i  rlVl'V^i 

T 

(l) 

1 r+T  * A , 

!“-t  ^L-'Vc- v«» 

T 1 l *1 

(2) 

Mean  Square  Error 

MSE^  : replace  | • | by  («)2  in  (1) 

MSE  : replace J • | by  (■ ) ^ in  (2) 
Error  Bias 

Error^  : replace  j • | by  (•)  in  (1) 
Error  : replace  ■ • , by  (•)  in  (2) 


Absolute  Error  Over  Forecast  F 

i£]J  /Fi  : replace  | • l by  M/Dt(1)  In  (1) 

• 4 

' £ |/F  : replace  j • | by  | * I / D (O  in  (2) 

l- 1 T 

Absolute  Error  Over  Actual  Denand  A 

IqlMi  : replace  | • I by  I * I/D  in  (1) 

4 

l€t  /A  : replace  I * | by  J • ( / Z D c in  (2) 

A *1 

Absolute  Error  Over  Average  of  Demand  and  Forecast 

kj/  1/2  (A^)  I 

j obvious 

Kl/  1/2  (A+F)  J 
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'4 


Relative  MAD 


MAD/AYD 
Relative  MSE 

mse/ (ayd) 2 

In  the  final  tabulation  of  the  algorithms,  we  looked  at  error 
measures  of  one  year  forecasts  since  this  corresponds  to  representative 
lead  times.  * • /F  and  |C|/A  have  built-in  disadvantages  when  F or  A 
equal  0 or  F,A  are  large.  MSE  is  more  sensitive  to  large  error  than  MAD. 
Final  four  measures  selected  are: 

MAD,  MAD/AYD,  MSE/ (AYD)2,  jci/l/2(A+F) 

The  lest  three  are  relative  measures,  necessary  when  combining  items  with 
different  demands.  The  MAD  is  useful  for  low  demand  items. 

Before  presenting  the  tabulated  results  (Section  4.5),  tabulated 
values  on  the  k-factor  are  presented. 

4.3  k-factor  Tables 

Methodology  is  presented  in  Orr  Q 3).  For  log  D and  log  D/H,  both  k 

/v  2 

and  q are  obtained  since  (i  « -1/2  q Is  needed  (equation  (25)  Chapter  III) . 
Stratifications  using  the  following  variables  were  investigated  - 


requisitions  per  year 
average  yearly  demand 

req 

AYD 

1/  Unit  Price 

1/UP 

dollar  demand 

AYD  • UP 

average  order  size 

AYD/req 

req  and  AYD  • UP  give  similar  patterns  by  strat  cell  which  are  explainable. 
Other  stratifications  did  not  yield  strong  patterns.  Table  4.1  gives  the 
k-values  by  item  requisition  for  the  four  processes,  D,  log  D,  D/H, 
log  D/H. 
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TABLE  4.1  k- FACTORS  BY  REQUISITION*  CLASS 


Cell 

Upper 

Bound 

0 

Items 

Avg 

Reg 

» 

k MA  | 

Qtrs, 

<\ 

log  D 
k 

MA 

Qtrs 

D/li 

k 

1 

MA 

Qtrs 

log  D/H 

% k 

MA 

Qtrs 

i 

1 

1489 

.59 

0 

1 

.16 

3.69 

3 i 

0 

1 

.34 

14.56 

6 

2 

2 

1354 

1.52 

3.164 

3 

1 

.20 

6.77 

a i 
• 

7-34 

5 

.38 

31.59 

8 

3 

3 

1176 

2.50 

4.251 

4 

.22 

8.12 

t 

5 

i 

14.18 

7 

.36 

48.13 

9 

4 

4 

873 

3.49 

1 4.399 

i 

4 

.26 

8.18 

1 

5 i 

20.79 

8 

.38 

52.71 

9 

5 

3 

636 

4.49 

• 

l 4.71 

4 

.26 

9.75 

5 

131. 19 

10 

.38 

54.71 

10 

6 

6 

513 

5.51 

3.464 

3 

.30 

7.67 

4 

*:28.31 

10 

.46 

54.7 

10 

f 

7 

8 

768 

6.95 

3.864 

3 

.34 

6.87 

4 i 

75.9 

13 

.40 

54.7 

10 

8 

12 

943 

9.74 

3.674 

3 

.36 

7.23 

1 

4 : 

1 

1 

c*£> 

eO 

'.42 

50.16 

10 

9 

18 

747 

14.68 

3.120 

3 

.42 

5.43 

3 

L 

cO 

i-38 

58.88 

10 

10 

06 

1204 

35.99 

2.022 

3 

.44 

3.96 

3 

co 

1.34 

77.0 

12 

For  D,  D/H 
For  log  D, 


MA  Qtrs 
log  D/H: 


found  from  B c 

MA  Qtrs  found  by  search  to  minimize  (A. 7) 
V.  error  in  forecasting  process  value 
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Analysis 


2 


2 


Remember  r is  process  variance  around  a mean  and  q is  associated 
with  short  term  correlation  in  changes  in  the  process  mean.  High  k 
reflects  stationary  processes;  low  k is  associated  with  short  term  trends. 

k values  for  D/H  and  log  D/H  processes  increase  with  increasing 
activity  (req) . This  is  because  demand  becomes  more  correlated  with  FH 
as  activity  rises.  The  mean  of  the  D/H  rate  becomes  more  stationary 
(higher  k) . Also  the  k values  are  higher  than  those  for  the  corresponding 
D and  log  D series  since  these  processes  are  more  volatile  and  reflect 
trends  in  FH. 

Note  that  for  D and  log  D series  that  k increases,  then  decreases 

2 2 

with  req.  For  low  ti  of  requisitions,  q is  high  (relative  to  r ) in- 
dicating that  demands  tend  to  come  in  correlated  "bunches".  For  high 
requisition  activity,  these  demand  series  show  trends  due  to  changes  in 
FH.  Hence  k is  somewhat  lower  at  top  and  bottom  of  these  columns  than 
in  the  middle. 

The  behavior  of  q under  log  transformations  (see  columns)  is  not 
fully  understood.  W 

4.4  Forecast  Algorithms  -Initialization  and  k-Updating  in  Computer 


Program 

Equations  for  KAL-1  in  (2)  and  (3)  Chapter  III  are  started  up  using 


*o  ‘ * + G0  (yo~/,) 


(3) 


(4) 


where 


y^  ■ initial  observed  value  of  process 

/i  m mean  of  a prior  distribution  on  X 
2 

T « variance  of  a prior  distribution  on  X 


2 


■ variance  of  estimate  y 

* i 


r 


o 


o 
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In  lieu  of  a catalog  approach,  using  statistics  on  groups  of  items 
2 

to  get  /\yT  j which  was  not  used  (see  Chapter  VII),  the  8 qtr  warmup 

period  was  used,  was  obtained  from  an  8 qtr  average  and  y from  the 

2 ° 2 

last  4 qtrs.  Assuming  some  constant  process  variance h in  warmup ,T  ^ 

2 2 

A /d  and  rQ©c  Therefore  G was  assigned  a weight  of  1/3, 

o 

For  KAL-2  , * 0 

For  moving  average  algorithms,  the  initial  xq  is  obtained  from  the 
previous  B quarters. 

Every  4 qtrs,  starting  with  8th  qtr,  k or  B is  updated  by  a table 
lookup  for  the  appropriate  process  based  on  the  current  8 qtr  moving 
average  estimate  of  the  yearly  requisitions. 

4.5  Tabulated  Results  on  Error  Measures 

The  following  16  tables  present  the  average  values  of  the  four  error 
measures  - MAD/AYD,  MSE/ (AYD) 1 , MAD,  ICl/l/2  (A+F)  - for  forecast  techniques 
applied  to  the  four  time  series,  {d),  {D/h},  {log  D$,  {log  D/H5.  The 
results  were  obtained  using  the  same  stratification  (on  average  requisitions 
which  gave  the  final  k-value6.  This  natural  consistency  in  performing 
stratifications  allows  one  to  observe  how  error  measure  values  vary  a6 
k-factors  change,  and  indicates  how  implemented  forecast  procedures  which 
may  vary  by  requisition  class  would  perform. 

Refer  to  Section  3.2  for  a description  of  the  designators.  Not  all 
designators  - time  series  - error  measure  combinations  are  included. 

Some  forecast  techniques  were  eliminated  due  to  preliminary  runs  with  un- 
promising results;  as  the  experimental  design  evolved  some  branches  of 
the  combinatorial  tree  were  not  climbed  to  a great  extent;  not  all  of  the 
modified  algorithms  based  on  Cohen's  results  (6ee  Section  3.2.2)  were  run, 
since  all  of  these  are  tested  in  the  simulator. 
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ALGORITHM 


ALGORITHM 


Cell 

r 

•I  tens 

AVg. 

Reqa/yyc 

MA4 

MA8 

MAI  2 

' 

MAKB 

KALI 

REG  KB 

REC8 

1 

1489 

1 -59 

1.134 

3.764 

10.265 

\ 

3.529 

3.682 

2.705 

3.293 

2 

1354 

1.52 

1.088 

1.382 

1.946 

> ’ 

1 

i 

i 

i 

1.629 

1.614 

1.386 

1.217 

3 

, 117$ 

2.50 

i i 

l i 

j 3.49  ; 

.892 

.960 

1.201 

i 

i 

i 

1.082 

1.093 

1.005 

.934 

4 

873 

.875 

.988 

1.174 

j* 

i 

i 

1.102 

j 1.091 

.955 

.886  j 

5 

636 

r l 

4.49 

l - 

.782 

.806 

.912 
j.  — ^ x 

i 

i 

1 

.912 

.873 

f 

.845 

.789  j 

1 

6 

D 

513 

. 5.51  < 

1 , 

1 ■ 

.768 

1 

< .836 

i 

.931 

1 

i 

r 

.928  j 

| .880 

.850 

l 

.786  j 

7 

768 

1 1 

6.95  i 

j 

j 

.723  » .745 

1 

.831 

1 

.879  | 

t 

.792 

.781 

.727 

8 

943 

9.74  , 

.658  | 

.671 

.734 

.776 

[ 

.687 

.720 

| 

.663  j 

9 

747 

14.68  | 

.593 

1 

.616 

. 

i 

.663 

1 

.701 

.621 

.648 

.610  ; 

10 

; 1204 

33.99  ! 

j 

.479 

.491 

.524 

.563 

.493 

.515 

.482 

9703 



1 

TOTAL. 

.829 

1.285 

2.392 

1.351 

1.341 

1.149 

i 

1.175  ! 

r 

»*»n  / »vn 


I 


ALGORITHM 


_Cell 

1 

2 

# 

■Items 

1489 

1354 

Avg. 

Reqs/yf' 

-.59 

...  ....  • 

1.52 

MA4 

MAKB 

kali 

KAL2-BQ  _ 

- KAL2-GFK 

1.219 

1.242 

1.041 

.889 

1.428 

1.325 

8.659 

| 7.991 

7.918 

1.808  j 1.605 

i 

1.733 

3 

| 

. 1176 

2.50 

. 

| 3*49  1 

1.073 

1.144  | .999 

1.135 

4 

1 

873  | 

.891 

.899 

f ... 

.778 

• 

.905 

1 

j 

5 

636 

.4.49 

1 .793 

.789 

i 

.717 

1 - - 

.672* 

l , 

* 1 

.788 

\ 

i 

1 

(O 

29 

513  i 

1 

. - J 

i 5.51  i 

| . 3 

.758  | .749 

.717 

.627*  j 

.742 

I 

[ 

7 

1 

768 

t 

6.95 

i 

.706  i 

. 

\ 

i .702 

I 

.660 

.588* 

1 

.690 

! 

8 

9 

943 

9.74 

: 

| 

.667 

! 

.669 

.622 

.569* 

.660 

i 

i 

747 

14.68 

.662  j 

.630 

.581 

.533* 

.623 

j 

i 

10 

, 1204 

35.99 

.550 

.551 

.515 

.451* 

.570 

r 

i i 

9703 

j 

TOTAL. 

.892 

.939 

2.076 

1.886 

1.975 

i 

t 

i 

. , 

ALGORITHM 


Cell 

Items 

Avg. 

Reqe/yr'’ 

MA4 

MA8 

MAKB 

KALI 

KAL2-BQ 

1 
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4.6  Analyses  of  Relative  Performances  and  Trends  in  Tables 


Trends  in  a Column 

For  the  MAD  measure,  values  increase  as  activity  (reqs)  increases, 
since  the  demand  is  growing  larger  and  hence  errors  increase.  For  the  other 
three  relative  error  measures,  the  general  tendency  is  for  column  values 
to  decrease  with  activity;  the  denominator  tends  to  increase  faster  than 
the  error  function  in  the  numerator.  In  some  cases  (especially  note 
| w 1/1/2  (A+F)Jthere  is  an  initial  increase  before  this  general  tendency 
takes  over;  for  the  first  few  cells  with  very  low  requisition  activity, 
there  are  aberrations  - frequent  zero  error  with  actual  and  forecast  being 
zero,  giving  very  low  average  values  of  the  measure  - after  which  increased 
occurrence  of  demand  spikes  amongst  the  zero  periods  raises  the  error 
measure  value  for  a tine. 

Relative  Performance  of  Algorithms  by  Series 

D series:  Expected  results  hold  across  the  four  measures.  For 

majority  of  cells,  KALI  is  best.  Good  performance  of  EXPSM  indicates  that 
part  of  KALI  performance  is  due  to  the  iterative  formula  of  exponential 
smoothing.  MAKB  does  a little  better  than  MA4. 

D/H  series:  Longer  base  periods  did  not  do  well  (MA4  best, 

MA12  worst).  The  data  base  has  strong  impact  here  since  rates  based  on 
very  low  FH  in  the  initial  warmup  period  can  give  quite  inaccurate  estimates 
of  the  D/H  rate  for  the  remainder  of  the  horizon  (shorter  base  periods  do 
not  pick  up  these  low  FH  or  do  not  keep  them  a.*  long).  KALI  does  better 
than  most  of  the  MA's  and  is  the  best  for  most  cells  under  measure 
\C 1/1/2  (A+F).  REGKB  and  REG8  do  better  than  KALI  for  three  measures  and  are 
quite  close  in  performance  between  themselves. 

log  D series:  MAKB  outperforms  MA4  in  the  middle  cells  but  not 

overall;  this  is  contra  theory.  KALI  is  generally  better  than  these  as 
expected  and  KAL2-BQ,  which  accounts  for  the  theoretical  bias  due  to  log 
transformations,  does  the  best  in  the  majority  of  cells. 


43 


log  D/H  series:  Explanation  is  basically  same  as  D/H  series. 

Log  transform  has  tempered  impact  of  low  FH  and  cell  1 results  are  not 
as  horrendous.  KALI  is  outperforming  the  MA's  in  most  of  the  cells. 

KAL2-BQ1 s performance  is  disappointing. 

Comparative  Performance  Between  Series 

D vs  D/H:  Values  for  comparable  columns  indicate  smaller  values 

for  D/H  series,  especially  for  the  higher  activity.  This  is  theoretically 
expected;  more  active  items  are  correlated  with  FH,  D/H  rates  are  relatively 
srable,  k-values  are  higher,  hence  forecast  errors  are  smaller. 

D vs  log  D:  Except  for  measure  jtf/l/2  (A+F)  (the  significance 
of  which  shall  be  seen  in  Section  4.7  and  Chapter  V),  the  error  measure 
values  for  log  D are  smaller  than  those  for  D.  This  is  apparently  due  to 
log  D forecasts  having  smaller  variance;  hence  the  overall  variance  of 
forecast  error  may  be  smaller,  although  the  bias  may  be  significant. 

D/H  vs  log  D/H:  Same  comments  as  above. 

log  D vs  log  D/H:  The  general  observation  is  that  values  for 

comparable  columns  are  smaller  for  log  D/H  for  less  active  items.  This 
is  counter-intuitive;  a theoretical  explanation  is  given  in  Orr  [/3]. 

4.7  Candidates  for  Further -Study 

Section  4.6  indicated  some  general  patterns  and  some  particular 
comparisons.  When  analyzing  all  16  tables  simultaneously  to  select  several 
promising  candidates,  one  must  be  circumspect.  The  "totals'*  must  not  be 
too  influential,  because  one  or  two  cells  might  have  had  large  impact.  Cell 
1 acts  strangely  in  many  cases  due  to  the  occurrence  of  many  zero-demand 
quarters;  anyway  the  final  forecast  algorithm  would  not  be  utilized  for 
very  inactive  items. 

The  "best"  algorithm  (I  shan’t  give  reasons.  One  may  check  tables) 
which  is  not  too  complex  is  a hybrid: 

Cells  1,2,3  Use  KAL2-BQ  - log  D/H 

Cells  4-10  Use  KAL2-BQ  - log  D 


LL 


Of  those  involving  FH  which  does  not  duplicate  (4.i)  and  is  not  a hybrid 

KALI  - log  D/H  (4.ii) 

Based  on  Cohen's  [4]  results,  REG8,  and  its  modification  REGKB  and  the 

2 

theoretically  modified  KAL-11  will  be  studied  further 


REG  8 

D/H 

REGKB  - 

D/H 

(4.1v) 

KAL-H2  - 

D/H 

(A.v) 

Two  algorithms  not  involving  Fli  are  chosen.  KAL2-BQ-log  D is  already  part 
of  4.i.  MAKB  - log  D was  chosen  over  KALI  - log  D since  it  was  a bit  more 
consistent  and  not  much  worse  than  MA4  - log  D,  but  more  interesting. 

Finally  KALI  was  chosen  as  the  algorithm  on  the  pure  series 

MAKB  - log  D (4.vi) 

KALI  - D (4. vii)  W 

The  performance  of  these  algorithms  in  terns  of  cost-effectiveness 
curves  based  on  simulation  results  are  presented  in  Chapter  V.  ^ 

4.8  Relative  Merits  of  Statistical  Error  Measures 

We  wish  to  have  some  indication  of  how  well  the  4 statistical  error 
measures  rank  the  algorithms  in  Section  4.7  as  compared  to  their  rankings 
by  cost  performance  in  the  simulator.  We  use  results  from  the  forthcoming 
chapter  on  simulation  runs  for  some  60  active  items  (HDV-Dynamic  group). 

To  be  comparative  we  obtained  average  rankings  for  the  last  5 cells  in  the 
appropriate  columns  of  the  tables.  The  results  are  shown  in  Table  4.3. 
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TABLE  4.3:  RANKINGS  OF  3 ALGORITHMS  BY  PERFORMANCE  MEASURE 


MEASURE 

REGK3 

D/H 

REG  8 
D/H 

ALGORITHMS 

KALI 

D 

MAKB 
log  D 

KALI 
log  D/H 

SIMULATOR  COST 
PERFORMANCE 

1 

2 

3 

4 

5 

MAD/AYD 

4 

2 

5 

3 

1 

MSE/AYD2 

4 

2 

5 

3 

1 

MAD 

4 

2 

3 

3 

1 

1/1/2  (A+F) 

2 

1 

3 

4 

5 

For  the  3 measures  MAD/AYD,  MSE/AYD  , MAD,  we  had  seen  previously  that 


the  algorithms  on  log  series  had  generally  lower  error  measure  values  than 
those  of  D,  D/H  methods.  These  3 measures  are  sensitive  to  variance  of 
the  forecast,  which  is  lower  for  "log"  algorithms.  Since 

2 

Variance  of  forecast  error  « variance  of  forecast  + (bias) 


+ process  variance, 


(5) 


these  "log"  types  perform  well  despite  bias  term.  However,  simulator  cost 
performance  apparently  is  sensitive  to  a bias  (consistent  over  or  under 
forecasting) . 

The  algorithms  involving  D,  D/H  have  higher  variance  of  error  (and 
hence  higher  MAD,  MSE)  but  lower  bias  and  this  is  reflected  in  their 
simulator  performance. 

Note  that  the  iC 1/1/2  (A+f)  measure  "tracks"  the  simulator  rankings 
fairly  well.  This  is  explainable;  briefly,  the  measure  is  related  to  a 
mean  square  error  on  the  logarithm  of  forecasts  and  in  calculating  variance 
of  the  log  of  the  forecast,  little  inherent  advantage  is  accrued  by  log 
series  algorithms.  However,  this  measure  can  obtain  values  only  between  0 
and  2;  it  is  less  discriminate  than  the  other  3 as  can  be  seen  from  tables. 
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The  following  summary  table  summarizes  the  merits  of  the  error 


measures. 


TABLE  4.4 


MERITS  OF  MEASURES 


PERFORMANCE 

MEASURE 

TYPE 

USEFULNESS 

MAD/AYD  - 

Forecast 

Initial  Screen:  gives  good  discrimina- 

MSE/(AYD; 

Error 

tion  of  log  algorithms  amongst  themselve 

l 

Statistic 

or  non-log  models  amongst  themselves 

! 

MAD 

i 

ti 

i 

As  above.  Especially  useful  for  inactiv 

1 

i 

items  (cells  1,2) 

jff/1/2  (A+F) 

■I 

Initial  Screen  - qualitative  rankings 
of  algorithms  correlates  with  simulator 
rankings.  Suffers  from  "sameness"  of 

1 

values. 

SIM 

Cost 

Final  Screen  - jseful  for  several 

1 

1 

Performance 

r candidates.  Tends  to  be  costly. 

I 

\ 

t 
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CHAPTER  V 


SIMULATION  ANALYSIS 

5.1  Simulator  Overview  & Special  Features 

The  final  selections  were  made  by  observing  the  algorithms*  performance 
in  Army  NICP  environment  using  the  DoDI  4140.39  simulator  (See  Cohen  [/7]). 
Subsequent  changes  to  the  simulator  and  a description  of  its  operation  is 
found  in  Cohen  [4-]* 

The  results  of  the  simulation  runs  appear  in  the  next  sections  in  the 
form  of  cost-performance  curves. 


The  curves  are  traced  thru  several  "A"  points  for  each  algorithm.  The 
lambda  (A)  values  reflect  an  operating  policy,  in  terms  of  a marginal 
cost  for  time  weighted  requisitions  short9  based  on  budgetary  constraints. 
See  Decmer,  Kruse  [6]  for  a complete  description. 

Features  of  Simulator  Operation  Differing  from  Cohen  [41  Runs 

The  algorithms  have  the  same  starting  conditions  prior  to  accumu- 
lating performance  statistics.  To  do  this,  during  the  warmup  period 
(2  years)  all  algorithms  utilize  the  MA8-D  algorithm.  Of  course,  also 
during  warmup,  the  algorithms  obtain  their  various  forecast  parameter 
starting  values. 

At  the  end  of  the  simulation,  excess  cost  is  charged  to  assets  over 
and  above  RO  assuming  projected  annual  demand  obtained  from  the  highest 
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forecast  among  MA4-D,  MA8-D,  MA12-D  predictions.  Projected  assets  re- 
maining after  this  maximal  forecast  is  a conservative  estimate  of  excess. 

Forecasting  Between  Quarters 

In  many  cases  policy  dictates  forecasts  at  times  other  than  on 
the  quarter.  The  algorithms  were  derived  for  forecasting  periodically 
(quarterly)  and  updating  parameters  every  quarter.  The  modification  for 
forecasting  between  quarters  is  to  use  the  algorithms  basic  relation  for 
x on  a '’moving"  quarter  of  observations  on  the  process  variable  y.  The 
new  values  are  not  retained  after  the  forecast,  nor  are  any  parameters 
updated. 

Example:  KALI  at  time  n+A  where  A is  a fraction  of  qtr. 


A 

x 


G (V 

n »i 


n+A 


« V 

- V 


where  is  a "noving"  qtr  up  to  time  n+A  . Then  forecast 

/n+.  (£)  ■ z*  These  values  are  not  retained  after  n4A. 

5 . 2 Initial  Runs 

The  seven  algorithms  of  Section  4.6  were  programmed  in  subroutines 

and  simulation  runs  were  made  for  various  values  on  60  HDV  - dynamic 

items.  These  runs  are  not  too  costly  because  of  the  few  number  of  items; 

but  these  costly  active  items  give  an  immediate  indication  of  the  impact 

of  using  program  factors.  The  resulting  curves  are  presented  in  Figure  5.1 

One  can  see  that  the  log  type  algorithmj  do  not  do  well  on  a cost 

2 

performance  measure.  The  three  D/H  algorithms,  REG8,  REGKB,  KAL-H  are 
clearly  superior,  indicating  that  use  of  FH  in  forecasting  is  warranted. 
(This  agrees  with  Cohen’s  results).  Hereafter  we  shall  investigate  only 
the  FH  algorithms  and  modifications;  the  results  for  D and  log  D series 
will  be  studied  in  a future  project  for  forecasting  common  items. 
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5 . 3 Final  Four  Algorithms  and  Resulting  Curves 


The  final  program  factor  algorithms  are  summarized  below.  1794 
is  the  designator  for  the  current  Army  program  factor  technique  and  is 
the  base  case  for  obtaining  relative  performances  and  cost  savings 
(Chapter  VI).  All  algorithms  operate  on  the  variable  y - D/H,  three 
of  which  are  weighted  moving  averages. 


REG8 : 


8 

x - Z w y 

n n-j+1  yn-j+l 


(1) 


2 8 2 

v ...  - H E IT  ... 

n-j+1  n-j+1  n-i+I 


(2) 


REGKB: 


As  above  with  KB  qtrs  for  8 qtrs 

KB  updated  yearly  based  on  requisition  class. 


/. 


1794: 


j.!  Vj+lVj+l 

8 

w jii  " H ./  I H . . 

n-j+1  n-j+1  n-i+1 


(3) 


Note  difference  in  weights  (2),  (3) 


KAL-H  : 


x - x . + G (y  - x .) 
n n-1  n wn  n-1 


(4) 


1 + kG 


n 


n+1  1 + k G + k H2/H2 

n n n+1 


(5) 


With  k updated  yearly  based  on  requisition  class. 


Yearly  forecasts  are  obtained  from  and  the  projected  FH  for  the 


next  4 quarters. 

D(year)  - ^ • (H^  + Hn+2  + + H^) 
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(6) 


- . ./ 


Simulation  Groups:  The  simulations  were  run  for  4 groups  of  items 

separately  (see  Chapter  II). 


HDV  - Dynamic  60  items 

HDV  - non-Dynamic  151  items 


LDV  - Dynamic  736  items  (722  PEMA  items) 

LDV  - non-Dynamic  ^ 8500  items  (the  few  PEMA  items  were 

not  included  in  the  results) . Due  to 
cos t of  runs,  1/4  of  these  items  were 
randomly  selected  for  simulation  in 
obtaining  average  costs  per  item  in  group. 


The  final  combined  curves  for  all  items  were  obtained  from  the  other 
4 graphs  by  weighting  costs  by  0 items  in  the  group  and  by  weighting  days 
by  If  requisitions  and  0 items. 

Overall  rankings  were  (best  to  worst) : 

KAL-H2,  REGKB,  REG8,  1794 

This  was  theoretically  expected.  Details  of  the  cost  savings  are 
discussed  in  the  next  chapter. 


1 
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CHAPTER  VI 


SAVINGS  & IMPLEMENTATIONS 
6.1  Cost  Savings  Over  1794  Policy 

From  the  curves  in  Figure  5.6,  we  can  obtain  the  annual  cost  savings 
per  item  at  a given  days  requisition  delay.  Seventeen  days  wait  is  an 
average  using  the  1794  policy  operating  at  current  >*  values. 

TABLE  6.1  PER  ITEM  SAVINGS  AT  17  DAYS  WAIT 


REG  8 

VS 

1794 

$100 

REGKB 

vs 

1794 

$120 

KAL-H2 

vs 

1794 

$180 

These  averages  were  obtained  from  a data  base  of  9433  items 
(see  Section  5.3).  However,  it  is  reasonable  for  exposition  and  mnemonics 
to  present  for  total  savings  a standard  AVSCOM  base  of  10,000  aircraft- 
peculiar  items  (and  which  constitute  the  bulk  of  safety  level  investne  it 
at  AVSCOM).  Most  of  this  savings  is  in  the  HDV-dynamic  group  (a  small 
group  of  active,  costly  items),  as  can  be  seen  in  Figure  5.2.  Table  6.2 
summarizes  the  pertinent  cost-savings  for  this  10,000  item  base. 

6.2  Implementation  Considerations 

The  $1  million  savings  for  REG8,  over  the  10,000  items,  on 
annual  investment  costs  to  obtain  the  same  performance  (in  terns  of 
mean  days  requisition  delay)  is  a significant  improvement  - the  result  of 
Cohen’s  investigations.  The  algorithm  is  easily  inplenentable  since  it 
is  a moving  average  type,  differing  from  the  current  1794  algorithm  only 
in  its  weights. 

The  REGKB  algorithm  yields  marginal  improvement  over  REG8  and  presents 
3 

Further  editing  reduced  data  base  of  Chapter  IV,  e.g.,  two  aircraft 
types  with  extremely  low  initial  FH  were  removed. 
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TABLE  6.2  SAVINGS,  PERFORMANCE  ON  10,000  ITEMS 

COMPARISON  COST  SAVINGS  AT  PERCENT  SAVINGS  DUE  REDUCED  DAYS  WAIT  (FROM  17) 

17  DAYS  WAIT  TO  HDV-DYN . AT  CONSTANT  COST 


REG8  VS  1794 

$1,000,000 

78.3% 

15.7 

DAYS 

REGKB  VS  1794 

$1,200,000 

75.57. 

15.4 

DAYS 

KAL-H2  VS  1794 

$1,800,000 

86.45;  1 

1 

14.8 

DAYS 

Ln 

vO 


I 


i 


On  average,  excess  cost  savings  442  of  total  savings 


implementation  problems;  some  of  the  requisition  classes  (sec  Table  4.1) 
require  15  qtrs  or  more  of  past  history  on  demand  and  FH  to  be  retained. 
( 4 years  or  more) . 

2 

The  additional  savings  for  KAL-H  is  dramatic  and  implementation  is 
feasible  but  presents  new  considerations.  The  formulae  in  equations  (4) 
and  (5)  of  Chapter  V look  forbidding,  but  are  not  really  complex.  We 
now  summarize  what  is  involved. 


Data  Retention  (above  current  requirements) : 

Table  of  k-values  by  requisition  class 
Current  value  of  k-factor 

Current  value  of  estimate  x of  mean  of  rate  D/H 
Current  value  of  "smoothing  constant"  G 

Updating  : Qtrly 

' ‘i  ' "S 

2 year  files  of  ( Dt J and  J H i and  } * 


G 

n 


1 + k G . 

n-1 

i + k c + k or  /ub 

n-i  n-1  n 

(1) 

x . + G • (D  /H  - x .) 
n-1  n n n n-1 

(2) 

Updating  : Yearly 

Compute  average  yearly  requisitions  from  last  8 qtrs 
Table  look  up  to  find  new  k 

Requisitions  0-1  1-2  2-3  3-4  4-5  5-6  6-8  >8 


k 


Forecasting 


0 

th 


At  n 


D -Jx 


7.34  14.18  20.79  31.19  28.31  75.9 
Qtr 


' • (1W  + 


H . , + 
n+2 


n+3 


»W 


999 


(3) 
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Forecasting  : Between  Qtrs 


z » x + C (°J-x)  (A) 

where  1 found  fron  interpolation  of  DRD  and  FH 
files  to  yield  a current  quarter  rate 

D - z • (years  projection  of  FH  at  current  time) 

There  are  also  necessary  special  procedures,  due  to  the  exponential 
smoothing  structure,  to  handle  adjustments  of  forecasts  due  to  backorder 
cancellations  and  to  breakout  forecasts  by  area  (if  an  item  migratec  to 
an  HDV  class).  ALMSA  can  modify  the  necessary  CCSS  routines,  with  IRO 
assistance,  to  implement  these  procedures. 

6. 3 Modifications  of  Algorithms  to  Use  End  Item  Density  as  a Program 
Factor 

IRO  did  some  additional  analysis  which  broadens  the  scope  of  application 
2 

of  the  KAL-H  algorithm.  Defining  f>  as  an  end  item  density  variable  and 
t i° j ] as  the  corresponding  time  series,  the  algorithm  of  Section  6.2  may 
be  used  with  f substituted  for  H and  a different  'able  of  k-values  as 
seen  below.  Commands  may  use  as  the  program  factor;  there  must  be 
some  justification  in  that  end  item  density  should  be  correlated  with 
some  usage  variable  (e.g.  flying  hours,  miles,  rounds  fired).  The  estimate 
x is  related  to  the  rate  D I f>  in  this  case  and  the  forecast 

V n'  V n+1  r+2  * n+3  n+4; 

Orr  [/3]  does  some  theoretical  analysis  which  relates  the  k factor 
for  D/^  to  the  k factors  for  D/H  by  the  residual  variance  of  a regression 
fit  of  H by  and  by  the  variance  of  the  time  series  (1°  t]  itself.  It 
was  found  for  AVSCOM  data  that  72%  of  the  variance  in  H could  be  explained 
by  variance  in  f>  . Therefore  the  demand/end  item  rate  is  less  stationary 
than  the  demand/FH  rate;  hence  smaller  k's  and  shorter  base  periods 
B (for  MA  algorithms)  are  called  for;  i.e.  less  weight  is  given  to  observa- 
tion on  D If  far  in  the  past.  The  following  table  is  instructive. 
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TABLE 

6.3 

K-FACTOR  FOR  3 ' 

TIME  SERIES 

D 

P//° 

D/H 

k 

£ 

k 

B 

k 

B 

0 

1 

0 

1 

0 

1 

3.164 

3 

4.02 

4 

7.34 

5 

4.251 

4 

5.765 

4 

14.18 

7 

4.399 

4 

6.25 

4 

20.79 

8 

4.71 

4 

6.91 

5 

31.19 

10 

3.464 

3 

5.16 

4 

28.31 

10 

3.564 

3 

5.55 

4 

75.9 

15 

3.674 

3 

5.88 

4 

oO 

3.120 

3 

4.99 

4 

60 

2.022 

3 

3.235 

3 

60 

60 

Note  that  forecasting  using  only 

D utilizes 

short  base  periods  in  MA 

algorithms  and  small  kf8  (less  stationary  process)^ whereas  k and  B 
increase  for  D/p  and  D/H  accordingly. 


V. 
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CHAPTER  VII 
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CONCLUSIONS,  RECOMMENDATIONS  & FUTURE  WORK 


7.1  Conclusions 

This  study  has  reinforced  Cohen's  findings  - that  forecast  algorithms 

utilizing  flying  hours  perform  better  on  the  AVSCOM  data  base  than  strictly 

demand  dependent  algorithms.  REC8  is  clearly  superior  to  the  current 

2 

Army  method  of  utilizing  FH  as  a program  factor.  KAL-U  yields  additional 
substantial  improvement  in  terms  of  cost  savings.  We  have  also  developed 
a rationale  and  presented  empirical  tables  for  forecasting  by  item  class 
(requisition  frequency).  A modified  algorithm  and  tables  for  forecasting 
using  end  item  density  as  a program  factor  have  been  presented. 


Other  Valuable  Conclusions  and  Results 


Moving  average  base  periods  should  be  short  ( Qtrs)  for 
( D ; series.  MA  base  periods  should  vary  by  item  class  for  ^ D/H j series. 
Several  candidates  (non-program  factor)  for  forecasting  common  items  have 
been  found.  Three  such  algorithms  are  KAL1-D,  MAKB-D , KAL2-3Q-logD. 


7.2  Recommendations 
2 

a.  KAL1-H  be  implemented  as  the  FH-based  algorithm  for  AVSCOM. 

ALMS A , with  IRO  assistance,  to  determine  the  best  way  of  modifying 
CCSS  routines. 

b.  Analogous  algorithms  be  used  at  other  major  subordinate  Commands. 
If  end  item  density  is  the  program  factor,  parameter  values  need 
to  be  adjusted. 

c.  IRO  be  tasked  to  obtain  the  best  non-program  factor  forecast 
procedure  for  common  items  (or  where  program  factor  not  feasible). 
Common  item  data  base  from  AVSCOM  be  used  to  further  screen 
candidates  found  in  this  study. 


7.3  Future  Research  - Aids  & Caveats 

Any  future  studies  on  demand  forecasting  at  the  wholesale  level  for 
Army  se.condary  items  which  use  this  report  and  Cohen  as  starting  points 
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should  be  aware  of  other  aspects  not  fully  discussed  in  this  report. 
Forecasting  at  other  Services  and/or  other  support  levels  should  find 
investigation  of  the  models  - algorithms  useful  but  not  necessarily  with 
the  same  parameter  values. 

k-values  - These  were  obtained  from  time  series  7 years  in  length. 

The  most  basic  assumption  in  this  forecasting  is  that  the  past  describes 
the  future.  However,  as  more  history  is  accumulated,  these  k /alues  should 
be  redetermined  on  some  periodic  basis  and  over  some  "moving"  base  length 
(say  5 or  7 years). 

Outlier  Analysis  - Little  work  was  done  on  determining  which  observa- 
tions in  a tire  series  are  erroneous  or  outliers  in  some  sense.  Some 
items  (see  Section  4.1)  were  deleted  because  of  very  large  forecast  errors. 
Also  it  was  found  that  1171  items  had  over  50%  of  their  total  demand  over 
the  28  Qtr  horizon  in  1 Qtr.  Mostly  these  are  inactive  items  and  are 
quite  unforecastable  by  any  technique. 

Other  Stratifications  - Section  4.3  listed  some  of  the  item  stratifica- 
tions. Reparable  - nor-reparable  breakouts  and  weapon  system  breakouts 
were  appended  to  these  strata;  some  weapon  systems  had  distinctive  k values 
for  D series,  but  this  was  not  pursued  due  to  performance  of  D/H  based 
algorithms.  Stratifications  by  IMPC  or  FSC  were  not  attempted. 

Error  Measures  - There  is  interest  in  finding  statistical  error 
measures  that  correlate  better  with  the  simulator  cost  performance. 

Weighting  quantitative  error  functions  (such  as  MAD)  by  unit  price  or  order 
size  may  prove  fruitful.  Future  work  which  could  quantify  a relation 
between  cost  performance  and  forecast  error  properties  would  reduce 
considerably  the  number  of  simulator  runs. 

Prior  Distributions  - Catalog  Approach 

For  the  Kalman  algorithms  where  prior  parameters  ) 

see  Section  4.4)  are  required  for  startup,  some  time  was  spent  on  devising 
techniques  to  use  statistics  on  a catalog  of  items  during  initial  experience 
or  warmup.  The  catalog  aspect  was  finally  scrapped  because: 
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a.  The  items  in  the  data  base  are  nore  heterogeneous  than  insurance 

items,  where  a catalog  approach  is  nore  sensible.  This  is  the  case  even 
using  a sub-catalog  based  on  an  item  stratification.  Due  to  heterogeneity, 
catalog  technique  can  give  quite  bad  estimates  for  Tv  on  a particular 

item. 

b.  We  were  unable  to  develop  a reasonable  procedure  for  scaling  or 
normalizing  a catalog. 

c.  After  2 years  of  warmup,  for  most  items,  much  weight  should  be 
given  to  data  experience  on  that  item. 

d.  Such  a catalog  procedure  would  not  accurately  reflect  real  world 
where  maintenance  factors  (engineering  estimates  of  consumption  rates)  and 
prior  distributions  based  on  some  other  classification  of  similar  items 
may  be  used. 

Other  Forecast  Techniques  Excluded  from  Investigation 

a.  Subjective  - not  practical 

b.  Segmentation  - individual  forecasting  methods  or  use  of  particular 
information  for  classes  of  items  - not  included  per  se. 

c.  Monitoring  methods  - problems  with  untrained  personnel,  clerical 
effort,  undesirable  response  to  transients. 

d.  Adaptive  filters,  stochastic  approximation  - too  many  data  points 
required;  item  dependent. 

e.  Box  - Jenkins  models  - Orr  [/3]  shows  the  relationship  to  techniques 
in  this  study.  However,  it  has  same  disadvantages  as  in  d. 

f.  Econometric  - Regression  methods  - only  done  for  FH.  KAL2  is 
actually  a general  form  of  a time  dependent  linear  regression  model. 

g.  Triple  Exponential  Smoothing  - performed  quite  badly  in  preliminary 
investigation  by  Orr  and  Cohen. 
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